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Abstract 


Since September 11, 2001, money and resources have been allocated at unprecedented 
levels in order to prevent future attacks on the United States. In the interest of preventing 
a similar type of incident, counterterrorism initiatives were funded using public funds 
with little or no oversight as to measuring the effectiveness of these programs. The 
purpose of this quantitative study was to determine if there was a statistically significant 
difference in the dependent variable — the level of awareness of participants (the ability to 
identify terrorism threats) who attended counterterrorism training that was solely lecture 
based and one that combined both lecture and demonstration. Three theoretical 
frameworks provided the foundation for this study: The organizational knowledge 
creation theory, adult learning theory and the experiential learning theory. The Solomon 
four-group design was employed using 412 test subjects who attended the Federal Bureau 
of Investigation’s National Improvised Explosives Familiarization/Chemical Industry 
Outreach Workshop . The results of a factorial ANOVA revealed no statistically 
significant difference in posttest scores between the inexpensive lecture and the more 
expensive lecture and demonstrations methodologies; however, the results from the 
paired ¢ test with a p < .001 did demonstrate cost-effectiveness with an average increase 
of 14 points in the level of awareness from pre- to posttest. The positive social change 
implications stemming from this study include recommendations to identify objective 
measures for program effectiveness in all government programs in compliance with the 
Administrative Procedures Act of 1981. If followed such actions would demonstrate good 


governance and are likely to increase the public’s trust. 
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Chapter 1: Introduction to the Study 


Introduction 


In the present economic conditions, public administrators are forced to scrutinize 
expenditures at every level and in every facet of governmental spending. The difficulties 
that administrators face is in finding the balance in meeting mission requirements and 
staying within the fiscal restrictions provided. This in itself seems to be a logical 
approach that, to an outsider, may appear to be easy to accomplish. The truth is this 
concept is easier to achieve in theory but in practice is a far more daunting task for 
administrators to achieve. 

The difficulty lies in determining which programs are providing the government 
the best return on investment. If a program is functioning in an efficient and effective 
manner, then the program’s budget should remain largely intact. However, if a program is 
underproducing or not producing the desired return on investment, those programs should 
receive further scrutiny and it should be considered whether redesigning the program, 
reducing the funding and functions of the program, or eliminating the program altogether 
and redistributing funding to productive ventures or to new ventures that lack adequate 
funding are the best options. 

This study serves as an example of how to measure a government program for 
effectiveness by studying one specific program. The program that I studied served as a 
“type” to demonstrate that all government programs can and should be measured for 
effectiveness to either justify the expenditure or to identify its short comings. I focused 


on the United States Government’s counterterrorism programs. More specifically, I 


looked at counterterrorism prevention and preparedness training. The training program 
that I selected was the Federal Bureau of Investigation’s (FBI) National Improvised 
Explosives Familiarization (NIEF) course/Chemical Industry Outreach Workshop 
(CIOW;; Federal Bureau of Investigation, 2015b; 2015f; 2014b) as noted above that 
served as a “type” and that demonstrated that courses can and should be measured for 
effectiveness. 

While this study was public policy-based, it crossed over a couple of academic 
disciplines. The reason being was, when dealing with program areas such as training, a 
policy-based decision is incomplete without considering the supporting educational 
theories that served as the basis for determining the effectiveness of the training 


evolution. The next section includes the background for this study. 


Background 


The terrorist attacks on September 11, 2001 caused the United States government 
to institute policy changes that affected the lives of citizens and visitors to United States 
(Mueller & Stewart, 2011). Americans were ill-prepared to address such threats to the 
United States. Never have there been such sweeping changes to United States as the 
changes that were instituted following the terror attacks. The United States was in shock 
and something had to be done to address the new threat and the future threats the country 
was likely to face (Kemp, 2012). In response to the attacks on 9/11, the Department of 
Homeland Security (DHS) was created in order to prepare for and prevent against future 
attacks (Kemp, 2012; Mueller & Stewart, 2011) . The United States began a war in 


Afghanistan and, a short time later, in Iraq as well. For the first time, first responders, 


public institutions, private corporations, and every citizen had a role in guarding this 
nation against the next inevitable attack by being vigilant in recognizing indicators for 
terrorist activities and to have a willingness to report those concerns (Kemp, 2012). 

Among the new trends in homeland security was the federal government’s new 
emphasis on protecting the nation from within its borders. The new emphasis was 
profitable to some federal, state, and local agencies and taxing to others (Hart & Ramsay, 
2011). New protective and training measures were instituted and were provided 
significant federal funding to support these initiatives flowed nearly unabridged in any 
fashion (Hart & Ramsay, 2011; Kemp, 2012; Mueller & Stewart, 2011). Grant money 
flowed from the federal government to state and local governments in the form of grants 
to help fund those agencies that would not otherwise have had the financial wherewithal 
to meet the new challenges (Mueller & Stewart, 2011). 

While many federal, state and local agencies benefited from these new initiatives 
through training and equipment through new federal funding streams these efforts 
themselves were not without their detractors (Mueller & Stewart, 2011). In the haste to 
fund these agencies, as stop-gap measures, administrators overlooked the need to be 
responsible with funding and to track where the money was going and whether or not the 
spending provided the desired results. Now, more than 15 years later the funds are 
disappearing and public administrators have come to realize with the funding streams 


drying up that they must be judicious in their allocations to fund programs. 


Problem Statement 


The events of 9/11 changed the United States’ government’s perspective 
concerning terrorism. As a direct result of the attacks, the federal government set forth to 
ensure that another 9/11 never happens again by instituting a number of initiatives, one of 
which is prevention and preparedness training primarily for first responders and security 
personnel from critical infrastructures (Turner, Glantz, & Gall, 2013). In the first 10 
years following 9/11, the United States government saw an increase in homeland security 
spending by more than one trillion in security measures and training initiatives (Mueller 
& Stewart, 2011). 

As noted above, a great deal of money has been spent to prevent acts of terrorism 
or prepare against future acts of terrorism, including various types of counterterrorism 
awareness training initiatives. These expenditures are a result of fear and trepidation that 
another 9/11 is looming and all citizens must be prepared to prevent or minimize the 
impact of such threats (Mueller & Stewart, 2011). 

As a result of this fear, government funds have been expended on various training 
initiatives with little to no attention given to their effectiveness, or whether the financial 
outlay provides a reasonable return on the government’s investment (Mueller & Stewart, 
2011). How then can the worth of the training be determined? This in itself is not an easy 
to answer and cannot be adequately addressed from a public policy perspective alone 
without first examining the training from an educational vantage point. 

The most common instructional method in counterterrorism training is lecture; 


however, lecture alone often makes it difficult for participants to retain the key learning 


points. Without combining lecture with a secondary approach, such as participation in a 
table top exercise that allows the participants to actively engage in the learning process, it 
is insufficient (Jackson, 2011). In normal lecture format, only verbal and auditory 
learners can connect with the training; however, by adding the table-top or other 
interactive instructional methodologies, kinesthetic learners have the opportunity to learn 
(Jackson, 2011). Within the field of adult education it is a commonly held belief that 
adult learners learn best when engaging multiple human senses (Arms, 2012; Bohonos, 
2014; Cantor, 2001; Federal Bureau of Investigation, 2009; Feemster, 2010). What is 
lacking, and where there is a gap in research literature is silent is in evaluating the link 
between instructional methodologies in counterterrorism training and determining which 
if either methodology provides a greater level of awareness and thus a great return on the 
government’s investment. 

The rationale behind my selection of explosive awareness as a counterterrorism 
program to study was that, since 1970, there have been over 141,966 terrorism related 
attacks worldwide and of those acts of terrorism, 68,074 used bombs or some sort of 
explosive material. Explosives were used in 48% of all terrorist acts worldwide (Global 
Terrorsim Database, 2015). By accounting for nearly 50% of the terrorists acts it is easy 
to believe that this sort of training is the government’s top priority. While it is a priority, 
it has been slow to become formalized (National Bomb Squad Commanders' Advisory 
Board, 2016). It is argued by the National Bomb Squad Commanders’ Advisory Board 
(NBSCAB) that not only would first responders benefit from this type of training but 
security personnel, private sector retailers and private and public policy makers as well 


(National Bomb Squad Commanders' Advisory Board, 2016). 


